Virtual Reality Simulation in Pediatric Resuscitation for Pre-hospital Providers.

This technical report explored the feasibility and utility of virtual reality (VR) pediatric resuscitation simulations for pre-hospital providers during their scheduled shifts. To our knowledge, neither the pediatric resuscitation VR simulation nor the feasibility of in situ, on-shift training with VR had been previously evaluated in pre-hospital providers. VR headset was available at an urban city fire station for 10 days where a total of 60 pre-hospital providers were scheduled to work. Providers were made aware of the VR module but no formal demonstration was done. There were no facilitators. Participants filled out an anonymous retrospective pre- and post-survey using a five-point Likert scale, rating their confidence from "not confident" to "very confident" in recognizing and managing pediatric emergencies. We found that VR simulation for pediatric resuscitation was a feasible training tool to use in situ as 63% of the providers were able to use it on shift. Furthermore, self-reported confidence increased after the training where responses of "very confident" increased from 20% to 30% for emergency medical technicians and 55% to 63% for paramedics.

Virtual Interviews and the Pediatric Emergency Medicine Match Geography: A National Survey.

Introduction: Virtual interviews (VI) are now a permanent part of pediatric emergency medicine (PEM) recruitment, especially given the cost and equity advantages. Yet inability to visit programs in person can impact decision-making, leading applicants to apply to more programs. Moreover, the cost advantages of VI may encourage applicants to apply to programs farther away than they might otherwise have been willing or able to travel. This could create unnecessary strain on programs. We conducted this study to determine whether PEM fellowship applicants would apply to a larger number of programs and in different geographic patterns with VI (2020 and 2021) as compared to in-person interviews (2018 and 2019). Methods: We conducted an anonymous national survey of all PEM fellows comparing two cohorts: current fellows who interviewed inperson (applied in 2018/2019) and fellows who underwent VIs in 2020/2021 (current fellows and those recently matched in 2021). The study took place in March-April 2022. Questions focused on geographic considerations during interviews and the match. We used descriptive statistics, chi-square and t-tests for analysis. Results: Overall response rate was 42% (231/550); 32% (n = 74) interviewed in person and 68% (n = 157) virtually. Fellows applied to a median of 4/6 geographic regions (interquartile range 2, 5). Most applied for fellowship both in the same region as residency (216, 93%) and outside (192, 83%). Only the Pacific region saw a statistically significant increase in applicants during VI (59.9% vs 43.2%, P = 0.02). There was no statistical difference in the number of programs applied to during in-person vs VI (mean difference (95% confidence interval 0.72, -2.8 - 4.2). A majority matched in their preferred state both during VI (60.4%) and in-person interviews (65.7%). The difference was not statistically significant (P = 0.45). Conclusion: While more PEM fellowship applicants applied outside the geographic area where their residency was and to the Pacific region, there was no overall increase in the number of programs or geographic areas PEM applicants applied to during VI as compared to in-person interview seasons. As this was the first two years of VI, ongoing data collection will further identify trends and the impactof VI.

National Characteristics of Emergency Care for Children with Neurologic Complex Chronic Conditions.

Introduction: Most pediatric emergency care occurs in general emergency departments (GED), where less pediatric experience and lower pediatric emergency readiness may compromise care. Medically vulnerable pediatric patients, such as those with chronic, severe, neurologic conditions, are likely to be disproportionately affected by suboptimal care in GEDs; however, little is known about characteristics of their care in either the general or pediatric emergency setting. In this study our objective was to compare the frequency, characteristics, and outcomes of ED visits made by children with chronic neurologic diseases between general and pediatric EDs (PED). Methods: We conducted a retrospective analysis of the 2011-2014 Nationwide Emergency Department Sample (NEDS) for ED visits made by patients 0-21 years with neurologic complex chronic conditions (neuro CCC). We compared patient, hospital, and ED visits characteristics between GEDs and PEDs using descriptive statistics. We assessed outcomes of admission, transfer, critical procedure performance, and mortality using multivariable logistic regression. Results: There were 387,813 neuro CCC ED visits (0.3% of 0-21-year-old ED visits) in our sample. Care occurred predominantly in GEDs, and visits were associated with a high severity of illness (30.1% highest severity classification score). Compared to GED visits, PED neuro CCC visits were comprised of individuals who were younger, more likely to have comorbid conditions (32.9% vs 21%, P < 0.001), and technology assistance (65.4% vs. 45.9%) but underwent fewer procedures and had lower ED charges ($2,200 vs $1,520, P < 0.001). Visits to PEDs had lower adjusted odds of critical procedures (adjusted odds ratio [aOR] 0.74, 95% confidence interval [CI] 0.62-0.87), transfers (aOR 0.14, 95% CI 0.04-0.56), and mortality (aOR 0.38, 95% CI 0.19-0.75) compared to GEDs. Conclusion: Care for children with neuro CCCs in a pediatric ED is associated with less resource utilization and lower rates of transfer and mortality. Identifying features of PED care for neuro CCCs could lead to lower costs and mortality for this population.

Medical Knowledge Acquisition during a Pandemic: Pediatric Subspecialty in-Training Examination and Board Certification Exam Passing Rate.

OBJECTIVE: The COVID-19 pandemic resulted in training programs restructuring their curricula. Fellowship programs are required to monitor each fellow's training progress through a combination of formal evaluations, competency tracking, and measures of knowledge acquisition. The American Board of Pediatrics administers subspecialty in-training examinations (SITE) to pediatric fellowship trainees annually and board certification exams at the completion of the fellowship. The objective of this study was to compare SITE scores and certification exam passing rates before and during the pandemic. METHODS: In this retrospective observational study, we collected summative data on SITE scores and certification exam passing rates for all pediatric subspecialties from 2018 to 2022. Trends over time were assessed using analysis of variance (ANOVA) analysis to test for trends across years within one group and t-test analysis to compare groups before and during the pandemic. RESULTS: Data were obtained from 14 pediatric subspecialties. Comparing prepandemic to pandemic scores, Infectious Diseases, Cardiology, and Critical Care Medicine saw statistically significant decreases in SITE scores. Conversely, Child Abuse and Emergency Medicine saw increases in SITE scores. Emergency Medicine saw a statistically significant increase in certification exam passing rates, while Gastroenterology and Pulmonology saw decreases in exam passing rates. CONCLUSIONS: The COVID-19 pandemic resulted in restructuring didactics and clinical care based on the needs of the hospital. There were also societal changes affecting patients and trainees. Subspecialty programs with declining scores and certification exam passing rates may need to assess their educational and clinical programs and adapt to the needs of trainees' learning edges.

Validity and reliability of the Turkish version of the Ottawa Sitting Scale in patients with acute stroke.

PURPOSE: To investigate the validity and reliability of the Turkish version of the Ottawa Sitting Scale (OSS-T) in patients with acute stroke. MATERIALS AND METHODS: The Berg Balance Scale (BBS) and Trunk Impairment Scale (TIS) were used to determine the validity of the OSS-T. The OSS-T was re-applied by the same rater after an interval of 7 days to determine the reliability. To test inter-rater reliability, the evaluation was repeated by a second rater 1 day after the first evaluation. Reliability was quantified using intraclass correlation coefficients (ICC), and validity was assessed by correlating the OSS-T scores with the results of the other measures. RESULTS: The ICC of the total OSS-T score for inter-rater reliability was 0.996 and for intra-rater reliability, it was 0.951. The Cronbach's α coefficient used to determine internal consistency was 0.980, which indicates excellent reliability. A strong positive correlation was found between OSS-T and TIS (rho = 0.861, p < 0.001), and between OSS-T and BBS (rho = 0.875, p < 0.001). An evident 2-factor structure was shown by the results of the factor analysis. CONCLUSIONS: The results of this study indicated that the OSS-T has strong measurement properties, making it a valid and reliable tool for research and clinical practice in patients with acute stroke.IMPLICATIONS FOR REHABILITATIONIndependent sitting function is an important indicator of functional recovery and discharge from hospital.Unlike other sitting balance tools, the Ottawa Sitting Scale can even categorize patients with low balance reserve by applying all the items with and without foot support.The Turkish version of the Ottawa Sitting Scale is a valid and reliable tool to evaluate sitting balance in patients with acute stroke.

Pediatric Emergency Medicine Fellowship Program Directors' Viewpoint: Minimum Levels of Entrustment for Graduating Fellows and Practicing Physicians to Perform the Subspecialty's Professional Activities.

OBJECTIVES: Entrustable Professional Activities (EPAs) are essential tasks physicians perform within their professions. Entrustment levels that pediatric emergency medicine (PEM) fellowship program directors (FPDs) expect graduating fellows to achieve for PEM-specific and common pediatric subspecialty EPAs remain unreported. This study aims to determine minimum entrustment levels FPDs require fellows to achieve to graduate from fellowship and to compare FPD expectations for fellows versus practicing PEM physicians. METHODS: Secondary analysis of PEM-specific data from a national multispecialty cross-sectional survey of pediatric subspecialty FPDs. For 6 PEM-specific and 7 common pediatric subspecialty EPAs, PEM FPDs indicated (1) minimum entrustment levels fellows should achieve by training completion, (2) whether they would allow a fellow to graduate below these minimum levels, and (3) minimum levels for safe and effective practice by PEM physicians. Minimum levels were defined as the level that more than 80% of FPDs would not drop below. RESULTS: Sixty of 77 PEM FPDs (78%) completed the survey. Most respondents did not require fellows to achieve the highest level (level 5-no supervision) by graduation for any PEM-specific EPAs. The median level FPDs expected for practicing PEM physicians was 5 (trusted to perform without supervision) for EPAs 1 and 4 and level 4 (indirect supervision for complex cases) for the remaining PEM-specific EPAs. Minimum levels expected by FPDs for common subspecialty pediatric EPAs were lower for both groups. CONCLUSIONS: Most PEM FPDs indicated that they would graduate fellows before their achievement of the highest entrustment level for all EPAs. Most also indicated that they do not expect practicing PEM physicians to perform all EPAs without supervision. These findings indicate need for stakeholders to evaluate current structure and outcomes of PEM fellowship programs and for institutions and organizations to ensure adequate support in time and resources for ongoing learning for practicing PEM physicians.

Pediatric Emergency Medicine Fellowship Procedural Sedation Training: Consensus Educational Guidelines.

OBJECTIVES: Pediatric procedural sedation (PPS) is a core clinical competency of pediatric emergency medicine (PEM) fellowship training mandated by both the Accreditation Council for Graduate Medical Education and the American Board of Pediatrics. Neither of these certifying bodies, however, offers specific guidance with regard to attaining and evaluating proficiency in trainees. Recent publications have revealed inconsistency in educational approaches, attending oversight, PPS service rotation experiences, and evaluation practices among PEM fellowship programs. METHODS: A select group of PEM experts in PPS, PEM fellowship directors, PEM physicians with educational roles locally and nationally, PEM fellows, and recent PEM fellowship graduates collaborated to address this opportunity for improvement. RESULTS: This consensus driven educational guideline was developed to outline PPS core topics, evaluation methodology, and resources to create or modify a PPS curriculum for PEM fellowship programs. This curriculum was developed to map to fellowship Accreditation Council for Graduate Medical Education core competencies and to use multiple modes of dissemination to meet the needs of diverse programs and learners. CONCLUSIONS: Implementation and utilization of a standardized PPS curriculum as outlined in this educational guideline will equip PEM fellows with a comprehensive PPS knowledge base. Pediatric emergency medicine fellows should graduate with the competence and confidence to deliver safe and effective PPS care. Future study after implementation of the guideline is warranted to determine its efficacy.

Clinical Presentation of Acute Osteomyelitis in the Pediatric Emergency Department.

OBJECTIVES: Acute osteomyelitis is a challenging diagnosis to make in the pediatric emergency department (ED), in part because of variability in its presentation. There are limited data detailing the presenting features of pediatric osteomyelitis, factors that are essential to understand to inform diagnostic decision making. We sought to describe relevant clinical data that contributed to the diagnosis of acute osteomyelitis in children presenting to a pediatric ED. METHODS: This was a 10-year retrospective cohort study of patients 18 years or younger diagnosed with acute osteomyelitis in the ED of a large tertiary care children's hospital. Collected data included demographics, clinical history, patient-reported symptoms, vital signs, physical examination findings, and results of basic laboratory, microbiologic, and imaging studies. Descriptive statistics were used to summarize key findings. RESULTS: Two hundred eleven cases of acute osteomyelitis were identified during the study period. The median age was 8.4 years, with 61.1% male. One hundred twenty-seven patients (60.2%) presented to care more than once before being diagnosed. Common symptoms included pain (94.3%), functional limitation (83.9%), and fever (76.3%). Common examination findings included functional limitation (78.2%), focal tenderness (73.5%), and swelling (52.1%). One hundred seventeen patients (55.5%) were febrile during their ED evaluation. Elevated C-reactive protein (>0.8 mg/dL, 92.9%) and erythrocyte sedimentation rate (>10 mm/h, 94.3%) were the most sensitive laboratory markers. CONCLUSIONS: Fever may be absent in up to a quarter of pediatric patients with acute osteomyelitis. Although highly sensitive, inflammatory marker elevations were more modest than those reported previously in cases of pediatric septic arthritis.

Effects of risk factors related to computer use on musculoskeletal pain in office workers.

Purpose. Work-related musculoskeletal disorders (WMSDs) are increasing due to overuse of desktop computers. This investigation examined musculoskeletal pain in office workers. Methods. Sociodemographic factors were recorded for 362 participants (female, 50.8%; male, 49.2%; mean age 37.35 ± 8.43 years). Participants were questioned for their daily working time, computer usage time and years, whether musculoskeletal pain was related to their job and whether pain disturbed their activities of daily living (ADLs). Working postures were observed and pain severity was evaluated by visual analog scale. Results. Participants more frequently had upper back pain (69.6%), neck pain (65.2%) and lower back pain (LBP) (64.1%) during the last 12 months; 60.5% of participants reported pain after they started work. LBP (32.9%), back pain (28.2%) and neck pain (22.9%) restricted participants' daily life. We found positive correlations between daily computer use and neck/upper back, and LBP. Conclusions. The most painful areas of participants using desktop computers were the upper back, neck, lower back and shoulder, and the pain in these regions affected ADLs negatively. This pain mostly occurred after the current job and these individuals experience more intense pain. Ergonomic approaches could reduce WMSDs and make workers more independent in ADLs and prevent chronicity.

Virtual Interviewing for Pediatric Emergency Medicine Fellowship-A National Survey.

OBJECTIVE: This study aimed to evaluate both applicant and interviewer satisfaction with the virtual interviewing process for pediatric emergency medicine (PEM) fellowship in hopes to improve the fellowship interviewing process. It was proposed that fellowship programs and applicants would prefer virtual interviews over traditional interviews. METHODS: A survey developed in collaboration with UT Southwestern PEM fellowship leaders and national PEM leaders was sent to all PEM fellowship applicants and programs at the conclusion of the 2020 interview season and rank list submission. The applicant survey obtained information on ease of virtual interviews and whether applicants felt that they obtained adequate information from virtual interviews to make informed program selections. Program director surveys collected data on thoughts and feelings about virtual interviews and obstacles encountered during the recruitment season. Both surveys asked about costs for interviews and interview type preference. RESULTS: A response rate of 49% from applicants and 47% from programs was obtained. Virtual interview days were similar in the amount of time and staff hours used compared with traditional days. Applicants spent less on virtual interviews compared with those who underwent traditional interviews (average $725 vs $4312). Programs received more applications than the prior year and spent less money during the virtual cycle. The majority of the applicants (90%) were comfortable with the virtual interview platform, and most (66%) agreed that virtual interviews provided adequate information to determine program rank. Geography was the number 1 rank determining factor. Programs and applicants preferred a form of in-person interviews. CONCLUSIONS: Virtual interviews provide cost savings for both applicants and programs. Despite this, both parties prefer a form of in-person interviews.

Improving Antibiotic Prescribing for Children With Urinary Tract Infection in Emergency and Urgent Care Settings.

OBJECTIVES: Children with urinary tract infection (UTI) are often diagnosed in emergency and urgent care settings and increasingly are unnecessarily treated with broad-spectrum antibiotics. This study evaluated the effect of a quality improvement intervention on empiric antibiotic prescribing for the treatment of uncomplicated UTI in children. METHODS: A local clinical pathway for uncomplicated UTI, introduced in June 2010, recommended empiric treatment with cephalexin, a narrow-spectrum (first-generation) cephalosporin antibiotic. A retrospective quasi-experimental study of pediatric patients older than 1 month presenting to emergency and urgent care settings from January 1, 2009, to December 31, 2014, with uncomplicated UTI was conducted. Hospitalized patients and those with chronic conditions or urogenital abnormalities were excluded. Control charts and interrupted time-series analysis were used to analyze the primary outcome of narrow-spectrum antibiotic prescribing rates and the balancing measures of 72-hour revisits, resistant bacterial isolates, and subsequent inpatient admissions for UTI. RESULTS: A total of 2134 patients were included. There was an immediate and sustained significant increase in cephalexin prescribing before (19.2%) versus after (79.6%) pathway implementation and a concurrent significant decline in oral third-generation cephalosporin (cefixime) prescribing from 50.3% to 4.0%. There was no significant increase in 72-hour revisits, resistant bacterial isolates, or inpatient admissions for UTI. CONCLUSIONS: A clinical pathway produced a significant and sustained increase in narrow-spectrum empiric antibiotic prescribing for pediatric UTI. Increased empiric cephalexin prescribing did not result in increased treatment failures or adverse patient outcomes. Future studies on implementing clinical pathways for children outside a pediatric hospital network are needed.

The Use and Impact of Professional Interpretation in a Pediatric Emergency Department.

BACKGROUND AND OBJECTIVE: Patients with limited English proficiency (LEP) experience worse health care outcomes compared to English proficient (EP) patients, and professional interpretation is underutilized in clinical settings. The objectives of this study were to describe patterns of interpreter use in a pediatric emergency department (ED), to determine factors associated with its use, and to examine differences in outcomes between EP families and those with LEP. METHODS: ED encounters for LEP and EP patients were reviewed in a retrospective cohort study design over a 15 month period. Generalized estimating equations were used to compare patient encounters and factors associated with interpreter use. RESULTS: Interpreter use for families who preferred a non-English language was 45.4%. Use of interpretation was less likely during busier times of day (odds ratio [OR] 0.85, confidence interval [CI] 0.78-0.93), with a lower triage acuity (OR 0.66, CI 0.62-0.70), and with each increasing year of patient age (OR 0.97, CI 0.96-0.98). LEP patients who did not receive interpretation were less likely to be admitted than EP patients (OR 0.69, 0.62-0.78). Patients of LEP families, with or without interpretation, were more likely to be transferred to the ICU within 24 hours of admission than patients of EP families (OR 1.76, 1.07-2.90; 1.85, 1.08-3.18) suggesting that an aspect of clinical severity may have been missed in the ED. CONCLUSIONS: Professional interpretation is currently underutilized in this ED for patients with LEP, and important differences in outcomes exist between LEP and EP patients. Factors associated with interpreter use will inform ongoing improvement efforts.

Pediatric Emergency Medicine Simulation Curriculum: Submersion Injury With Hypothermia and Ventricular Fibrillation.

Introduction: Submersion injury or drowning is a leading preventable cause of pediatric mortality and morbidity. Submersion injuries are often accompanied by hypothermia and asphyxia that can lead to inadequate oxygen delivery to tissues and subsequent cardiac arrhythmias. Methods: This simulation-based curriculum involves the identification and management of a submersion injury in a 4-year-old boy who was rescued from a cold-water submersion. The simulated patient is apneic, pulseless, bradycardic, and hypothermic; he is being bag-mask ventilated on arrival without intravenous access. He ultimately develops ventricular fibrillation. Providers must recognize the degree of submersion injury, initiate early airway protection, adequately address circulation, and be alert to developing hypothermia and cardiac arrhythmias to prevent further decompensation. This scenario can be modified based on trainee level (pediatric residents vs. pediatric emergency medicine fellows). Results: A total of 22 trainees (PGY 1-PGY 6 pediatric residents and pediatric emergency medicine fellows) participated in this simulation curriculum on separate occasions and rated it as an overall positive learning experience. The curriculum's goal is to provide learners with an opportunity to manage life-threatening pediatric submersion injuries, where the correct steps need to be taken in a limited period of time. Discussion: We have provided preparatory materials to help instructors set up, run, and debrief the scenario in a standardized fashion. The debriefing tools allow for adaptation depending on learners' needs and individual experiences during the simulated scenario. Also included are supporting educational materials and a learner feedback form that can be used to evaluate the session.

Wound management.

The care of wounds is common in pediatric practice. Most simple wounds can be handled by clinicians in the office or by trained emergency medicine clinicians. Knowledge of appropriate wound care, wound repair techniques, and judicious use of antibiotics for prophylaxis ensures the best possible long-term outcomes. The following review describes appropriate recommendations for acute and long-term wound care, management, and special circumstances common to pediatric practice.

Managing pediatric dental trauma in a hospital emergency department.

PURPOSE: The purpose of this study was to: (1) examine types of dental trauma presenting to a hospital emergency department (ED); (2) describe the medical services provided to these patients; and (3) quantify time spent during ED encounters for dental trauma emergencies. METHODS: Records of 265 patients who presented to the ED with dental trauma over a three-year period were reviewed. Demographics, injury types, triage acuity, pain scores, and dental/medical treatment and times were analyzed. RESULTS: Patient demographics and injury types were similar to previous studies. Eighty-two percent of patients received mid-level triage scores; 41 percent of patients had moderate to severe pain. The most frequently provided medical services were administration of analgesics and/or prescriptions (78 percent). The mean times were: 51 minutes waiting for a physician; 55 minutes with dentists; and 176 minutes total time. Higher triage acuity and pain levels resulted in significantly longer wait times for physician assessment. Dental evaluation, including treatment, averaged 32 percent of time spent at the hospital. CONCLUSIONS: A dental clinic is the most efficient venue for treating routine dental trauma. Patients in this study spent the majority of time waiting for physicians and receiving nondental services. Most patients required no medical intervention beyond prescriptions commonly used in dental practice.

Increasing pediatric resident simulated resuscitation performance: a standardized simulation-based curriculum.

AIM: Studies demonstrating the impact of resuscitation simulation curricula on performance are limited. Our objective was to create and evaluate a simulation-based resuscitation curriculum's impact on pediatric residents' performance in a simulated resuscitation. METHODS: We developed a standardized simulation-based pediatric resident resuscitation curriculum consisting of nine modules, incorporating four domains (basic skills, airway/breathing, circulation and team management) and specific topics (e.g., anaphylaxis). Each module was presented four times over the academic year. Evaluation of the curriculum consisted of pre- and post-intervention video-recorded performances of a simulated pediatric resuscitation by 10 resident resuscitation teams, scored using the Simulation Team Assessment Tool (STAT). The effectiveness of the standardized curriculum on medical (basics, airway/breathing, circulation) and team management, and on knowledge test scores was evaluated by comparing pre- and post-intervention STAT scores using unpaired two-sided T-test. The impact of group curriculum participation on team performance (STAT scores) was analyzed using linear regression. RESULTS: Overall team performance STAT scores increased post-intervention (mean pre-test 0.61, post-test 0.74, p<0.001), as did management of the basics of resuscitation, airway/breathing and teamwork (mean basics: pre 0.46, post 0.62, p=0.001; mean airway/breathing: pre 0.63, post 0.76, p=0.01; mean teamwork: pre 0.61, post 0.79, p=0.003). Regression analysis provided evidence for a training "dose-response" among the post-intervention teams, with teams exposed to more training achieving higher performance scores (p=0.004). CONCLUSIONS: We created a standardized simulation-based pediatric resuscitation curriculum that increased pediatric residents' scores on medical management and teamwork skills in a dose dependent relationship.

The Simulation Team Assessment Tool (STAT): development, reliability and validation.

INTRODUCTION: Simulation sessions prepare medical professionals for pediatric emergencies. No validated tools exist to evaluate overall team performance. Our objective was to develop and evaluate the inter-rater reliability and validity of a team performance assessment tool during simulated pediatric resuscitations. METHODS: We developed the Simulation Team Assessment Tool (STAT) which evaluated 4 domains: basic assessment skills, airway/breathing, circulation, and human factors. Scoring of each element was behaviorally anchored from 0 to 2 points. Two teams of resuscitation experts and two teams of pediatric residents performed the same simulated pediatric resuscitation. Each team was scored by six raters using the STAT. Intraclass correlation coefficients (ICC) were calculated to assess inter-rater reliability. Overall performance and domain scores between expert and resident teams were compared using repeated measures of analysis of variance to assess construct validity. RESULTS: ICCs for overall performance were 0.81. Domain ICCs were: basic skills 0.73, airway/breathing skills 0.30, circulation skills 0.76, human factors 0.68. Expert versus resident average scores were: overall performance 84% vs. 66% (p=0.02), basic skills 73% vs. 55% (p<0.01); airway 80% vs. 75% (p=0.25), circulation 90% vs. 69% (p=0.02), human factors 89% vs. 66% (p=0.02). CONCLUSIONS: The STAT's overall performance, basic skills, circulation, and human factors domains had good to excellent inter-rater reliability, discriminating well between expert and resident teams. Similar performance in the airway/breathing domain among all teams magnified the impact of a small number of rater disagreements on the ICC. Additional study is needed to better assess the airway/breathing domain.